Reversing Bonferroni

نویسندگان

چکیده

It is common for conclusions of empirical studies to depend on multiple significant outcomes. This practice may seem reasonable, but it has some unintended effects. In particular, the compound Type I error rate (the likelihood concluding that an effect exists when does not) can be much lower than individual studies. in itself not a problem since low desirable. However, there also accompanying drop power, meaning probability finding support true low. Currently, no standard statistical method dealing with hyper-conservative and power results from investigations requiring Here, we propose novel solution this problem: We show sometimes appropriate reverse logic classic Bonferroni correction increase significance criterion order maintain intended across tests. approach dramatically improves encourages careful planning analyses prior data collection. To avoid adding list questionable research practices contaminate psychological research, suggest restricted situations where authors pre-register their analysis plans.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

What Is the Bonferroni Correction?

The Bonferroni correction is an adjustment made to P values when several dependent or independent statistical tests are being performed simultaneously on a single data set. To perform a Bonferroni correction, divide the critical P value (α) by the number of comparisons being made. For example, if 10 hypotheses are being tested, the new critical P value would be α/10. The statistical power of th...

متن کامل

Holm ’ s Sequential Bonferroni Procedure

The more statistical tests we perform, the more likely we are to reject the null hypothesis when it is true (i.e., a “false alarm,” also called a “Type 1” error). This is a consequence of the logic of hypothesis testing: We reject the null hypothesis for rare events, and the larger the number of tests, the easier it is to find rare events which are false alarms. This problem is called the infla...

متن کامل

A Bayesian perspective on the Bonferroni adjustment

Bayes/frequentist correspondences between the p-value and the posterior probability of the null hypothesis have been studied in univariate hypothesis testing situations. This paper extends these comparisons to multiple testing and in particular to the Bonferroni multiple testing method, in which p-values are adjusted by multiplying by k, the number of tests considered. In the Bayesian setting, ...

متن کامل

Bonferroni-Galambos Inequalities for Partition Lattices

In this paper, we establish a new analogue of the classical Bonferroni inequalities and their improvements by Galambos for sums of type ∑ π∈P(U)(−1)(|π| − 1)!f(π) where U is a finite set, P(U) is the partition lattice of U and f : P(U) → R is some suitable non-negative function. Applications of this new analogue are given to counting connected k-uniform hypergraphs, network reliability, and cum...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Psychonomic Bulletin & Review

سال: 2021

ISSN: ['1531-5320', '1069-9384']

DOI: https://doi.org/10.3758/s13423-020-01855-z